A multi - user solution for design review in real - time

IMMIView is an interactive system that rely on multiple modality and multi-user interaction to support collaborative design review. It was designed to offer natural interaction in visualization setups such as large scale displays, head mounted displays or TabletPC computers. To support architectural design, our system provides content creation and manipulation, 3D scene navigation and annotations. Users can interact with the system using laser pointers, speech commands, body gestures and mobile devices. On this paper, we describe how we designed a system to answer architectural user requirements. In particular, our system takes advantage of multiple modalities to provide a natural interaction for design review. We also propose a new graphical user interface adapted to architectural user tasks, such as navigation or annotations. The interface relies on a novel stroke based interaction supported by simple laser pointers as input devices for large scale displays. Furthermore, input devices like speech and body tracking allow IMMIView to support multiple users. Moreover, they allow each user to select different modalities according to their preference and modality adequacy for the user task. We present a multi-modal fusion system developed to support multi-modal commands on a collaborative, colocated, environment, i.e: with two or more users interacting at the same time, on the same system. The multimodal fusion system listens to inputs from all the IMMIView modules in order to model user actions and issue commands. The multiple modalities are fused based on a simple rule-based submodule developed in IMMIView and presented in this paper. User evaluation performed over IMMIView are presented. The results show that users feel comfortable with the system and suggest that users prefer the multi-modal VIMMI group, INESC-ID Department of Information Systems and Computer Science IST/Technical University of Lisbon Rua Alves Redol, 9, 1000-029 Lisboa, Portugal. E-mail: [email protected], [email protected], [email protected], [email protected], [email protected] approach to more conventional interactions, such as mouse and menus, for the architectural tasks presented.